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ABSTRACT 



An image pickup apparatus including an image extracting 
unit and performing anfimagQxtraction process^andr^ 
cmatic^fecdbackcon trol of white ba lance^for executing image 
extraction with high accuracy by performing the image 
extraction process and automatic white balance control with 
reference to each other. 

8 Claims, 4 Drawing Sheets 
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IMAGE PICKUP APPARATUS WITH IMAGE FIGS. 3(a)-3(c) show standardized color difference plane 

EXTRACTING UNIT diagrams for explaining the control operation of an image 

pickup apparatus in relatbn to a third embodiment of the 
BACKGROUND OF THE INVENTION present invention; 

i r- ij f .u T *• ^ FIGS. 4{a)-4(c) show Standardized color difference plane 

1. Field of the Invention ^ i • * * i f fL^™^ 

diagrams for explaining the control operation of an image 
The present invention relates to an image pickup appara- -^^^ apparatus in relatioD to a fourth embodiment of the 
tus comprising an image extracting unit and particularly to present invention, 
an image pickup apparatus for performing an image extrac- 
tion process and automatic feedback control of white bal- DESCRIPTION OF THE PREFERRED 
ance. EMBODIMENTS 

2. Description of the Related Art ^IG. 1 is a block diagram of an image pickup apparatus 
Regarding the image extraction process, Japanese Patent providing an image extracting function in relation to a first 

Application Laid-Open No. 225328/1994, which_corre- embodiment of the present invention wherein an image 
spends to U.S. Pat. No. 5,412,487, descr ibeOie.stablP" 15 pjckup apparatus 1 having an image extracting function 

[e xtraction ^fggobject, depending on the extracting condi- includes an tifegCpickup^unitlllTl^gnal processorlliT 

ti'on on a standardized color difference plane, by standard- controUefI13ZandlLnIimag e'extractin g-u mt-14 i 

izing a color difference signal with a luminance signal. ^^^^ pickup uniTll includes a lens block 111 whicb 

In regard to automatic white balance control, Japanese performs automatic focus control, automatic iris control and 

Patent Application Laid-Open No. 344530/1993 describes zoom control or the like and an image pickup element 112 

performance of automatic white balance control with higher which converts light having passed the lens block 111 into 

accuracy by utilizing an intelligent algorithm recognizing an electrical signal. The signal processor 12 includes a 

the image pickup environment. CDSAGC (Correlated Double Sampling Automatic Gain 

However, the feedback type automatic white b alance Control) circuit 121 for eliminating noise from an image 
control generates a malfunction bycferroneously^judging-as^ signal obtained from the image pickup element 112 and for 

whitO^loOpproSn amplifying signal gain, an A/D converting circuit 122 for 

^ ^small- amount ^'whit e-isin cluded in an imagcpresulting in converting the signal obtained from the CDSAGC circuit 

change of Tdegree of color saturation and hue of the image 121 into a digital signal, and a digital ^nal processing LS I 

picked up. As a result, it becomes difficult in the image 123 forexeci^ng^te^^ignal^pr^ 

extraction process for extracting an object on the standard- [wMtcMlahpe^controiPelectronic zoom control or the hke on 

ized color difference plane to extract the object with high the image signal obtained from the A/D^ converting drcuit 

accuracy due to a change of distribution of the object on the 122. 'HicxontroUer 13 includes a coritf6l1microcompj[iter.l31' 

standardized color difference plane. rfoOptforming-various arithmeticprocessings-to-control the 

rlcns~bl ock'U l7ldig ital"si gnal'process^^ 

SUMMARY OF THE INVENTION ^^(^^^ge;;6xff^tiooffit:i4::'The image extraction unit 14 

^ . , ^ , . . o . • . includes an image extraction processing circuit 141 for 

It is therefore an obiecl of the present mvention to . j j- • i j cc • i lu i 

* . J y standardizmg a color difference signal with a luminance 

overcomejhe^e^esccibed problems andao_execu^e:5 to-extract-arobjcct-dcpcnding-on-thc-extracting. 

Cmage^extrachon^ath^iglMZOTCjc^^^ —^j^j/^ standardized.color difference plane: 

tmage"extrac tibn process and,automatic3vnite_balancc„con-^ 40 — - - y ^ 

ctOTtCrefeTenc^^CT^thefD Accoidmg to a fiist embodiment, the control microcom- 



. . puter 131 detects the state of the image extraction processing 

In accordance with the present invention an image pickup ^.^^^^ ^^^^^^ microcomputer 131 suspends or 

apparatus comprises an^age-pj^pmit^for pickmg up an .^^.^.^^ operation of the automatic white balance control 

image,asjgnal:piocessorforpi^ of digital signal processing LSI 123 when an image is being 

the image pjckup unit, an unage.extracUng umtior,extract^ 45 ^^^^^^^^^ extraction processing circuit 141. 

mg'an object, and a controller tor controlling the unage ^ , - ■, . ^ ^ c -ir — * 1. — — ^ 

, -4 • 1 J •„ * T- As explained above.^extraction of aa„object.can.De„per- 

pickup unit, signal processor and image extracting unit. . . . . ^; . — f— ^ 

^ ^ , ^ ^, . . . formed-with"higher accuracy_dependmg_onJhe„extracting 

In accordance with a feature of the present mvenuon, the ^ditiSF^e^standardiz^^ 

controUer performs the control in accordance with a rela- l^gbitin^Si^^^ 

tionship between the image extraction process by the miage ^duriE^&elm^^i^raiioaprocessm^ 

extracting unit and the automatic white balance control by ^^^^rS^f^f-^ 

the signal processor. cbalance-contr ol. 

Other objects and advantages of the present invenUon will According to the present invention, the image pickup 

be apparent from the followmg detailed descnption of the apparatus of FIG. 1 is utilized for other embodiments as 

prcsenUy referred embodiments thereof, which descnption explained below, wherein the control microcomputer 131 

should be considered in conjunction with the accompanying performs different control. 

drawings in which: Pj^g 2(fl)-2(c) respectively show standardized color 

BRIEF DESCRIPTION OF THE DRAWINGS difference plane diagrams and are utilized to explain the 

60 operation in accordance with a second embodiment. 

FIG. 1 is a block diagram of an image pickup apparatus Numeral 21 designates an object extracting condition which 

providing an image extracting function in relation to the a is set under the desired hue and degree of color saturation 

first embodiment of the present invention; and numeral 22 designates a distribution of chromaticity of 

FIGS. 2(fl)-2(c) show standardized color difference plane the object on the standardized color difference plane. When 
diagrams for explaining the control operation of an image 65 the automatic white balance control is performed by the 

pickup apparatus in relation to a second embodiment of the digital signal processing LSI 123 during extraction of the 

present invention; object in the image extraction processing circuit 141, due to 
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a malfunction of the automatic white balance control, the balance control of digital signal processing LSI 123 as 
hue and degree of saturation change from the desired indicated by the above formulae (9) to (12). Therefore, the 
condition. As a result, the distribution 22 of chromaticity of control microcomputer 131 controls the image extraction 
the object on the standardized color difference plane changes processing circuit 141 based on the update condition as 
as shown in FIG. 2(b). Under the distribution 22 of chro- 5 shown in FIG. 2(c) of automatic white balance control of the 
maticity of the object and extracting condition 21 as shown digital signal processing LSI 123 in accordance with the 
in FIG. 2(b), it is difiScult to extract the object with high formulae (9) to (12). 

accuracy. Therefore, when the automatic white balance As described above, according to the second embodiment, 

control of digital signal processing LSI 123 is performed when the 'aiitQniatic3^1iitc_t>alancc _ contronis ^crfgrmed^" 
during image extraction by the image extraction processing lO ^during cxtractio n"6f the^b ject, extraction of the oHjcct can 
circuit 141, in accordance with the second embodiment, the be^btained with high accuracy by updating the extracting 
control microcomputer 131 controls the image extraction conditions of the image extraction processing circuit 141 
processing circiiit 141 to update the extracting condition of under the control of the microcomputer 131 as shown, 
the image extraction processing circuit 141 based on an Next, a third embodiment of the present invention will be 
updating condition of automatic white balance control of the is explained with reference to FIGS. 3(a)-3(c) which respec- 
digital signal processing LSI 123 as shown in FIG. 2(c). lively show standardized color difference plane diagrams. 
Color difference signals R-Y and B-Y can be obtained, Numeral 31 designates an object extracting condition which 
depending on the foQowing formulae (1) and (2), from the is set under the desired hue and degree of color saturation 
primary color signals R, G, B generated by the digital signal and numeral 32 designates distribution of chromaticity of 
processing LSI 123. 20 the object on the standardized color difference plane as 

shown in FIG. 3(fl). 

/i-y-o.7Qfl-o.59<^O.iiB (1) When a color temperature of a light source changes in an 

image, the distribution of chromaticity of the object on the 
standardized color difference plane 32 also changes. In this 
Substituting (XI, Yl) and (X2, Y2) in formulae (1), and ^ the control microcomputer 131 controls the distribu- 
(2), formulae (3)-(6) are obtained. ^^^^^ °f chromaticity of the object on the standardized color 

difference plane 32 so as to return to the initial condition of 
RL^0J(iBXi'O.59GXU0.nBXi (3) the automatic white balance control, when the color tem- 

perature of a light source changes. This operation is a feature 
fiZ,-o.3Q/in-o.59Gn+o.89jyi (4) 30 of automatic white balance controL 

(jtloweyerrwhenXcon^ 
(^ch^objectjscontinuoi^ 
BH'^o.30RYi-Q.59GY2+o.89BYi (6) cpftrackmg:the]gbjee^^^^^ 

the^^t^signal_proceMinigrl^ 
Therefore, when the primary extracting conditions of 35 ig^jneFate a-malfun cti onif tfae distrib^ 
image extraction processing circuit 141 on the standardized of^igct ^on-the'stand afdizedlcdlorl^ 
color difference plane are given by the above formulae (3) changed-as-shown-in-FIG~3(fc)j^ 

to (6), the conditions are set by (RL, BL), (RH, BH) as ^Tfiere^foreTthrcooEoinm^ 131 controls the 

shown in FIG. 2(a). image extraction processing circuit 141 so as to continue 

Next, when the gain adjustment is performed on the 40 extracting an image based on the last extracting condition of 
primary color signals R, B through the automatic white image extraction processing circuit 141, so that the distri- 
balance control of the digital signal processing LSI 123, the bution 32 of chromaticity does not change on the standard- 
standardized color difference signals R-Y and B-Y can be jzed color difference plane of the object as shown in FIG, 
obtained as indicated by the formulae (7) and (8). 3(c). Accordingly, the extraction of the object is performed 

45 with high accuracy by performing the automatic white 
R-r=Qjm^^r)-o.S9G-OAiB(Ub) (7) balance control based on the last extracting condition under 

fi-ro-o.30/((i+r)-o.59G+o.89B(i+6) (8) control of the microcomputer 131. 

A fourth embodiment of the present invention will be 
Here, r and b indicate an amount of compensation of the explained with reference to FIGS. 4(a)-4(c) which respec- 
primary colors R and B. Substituting (XI, Yl) and (X2, Y2) 50 tively show standardized color difference plane diagrams. In 
in formulae (7) and (8), formulae (9)-(12) are obtained. these figures, numeral 41 designates an object extracting 

condition which is set under the desired hue and degree of 
RL'^jQiai{UryQ.59GXUQAiBXi{u^^^^^^ ^olo^ saturation and numeral 42 designates distribution of 

O.UBXl)+0.'7Qimr-0.11BXlb''RLi-iOJQIVClr-0,UBXlb) (9) , *■ f*u u- * * a a- a ^ a-pp 

' ^ chromaticity of the object on the standardized color differ- 

BL'— o.3Q«Yi(i+r)-0.59GTi+o.89flyi(i+fc)-(-o.3QRyi- 55 ence plane as shown in FIG. 4(fl), 

o.59Gn+o.89Bn)+(-o,3Qmr+a.89Bya6)=JX+C-03Qfinr+ As in the case of the third embodiment, it is assumed that 

0.89Jnb) (10) distribution 42 of object has changed due to malfunction of 

/?/f-0.70/i;t2(u.)-0.59c;^o.ll^^i^)-(0.7Q«;^-0.59(;;^- automatic white balance control as shown in FIG. 4(i)). 

a.ii5A^)+(OJO/2y2;-o.ii5;Kb)-jy/+(D.70/ta7;-o.iiiEA2 in embodmient, the control microcomputer 131 effects 

b) (11) 60 control so that the extracting condition 41 of the image 

extraction processing circuit 141 is updated, as shown in 

^'^:f.^'^^l:'};^<^Jl^:^^^ FJG. 4(c), based on the automatic white balance control in 

0.59Cra+0.89B17)+(-0.3aRy2rfO,89By2iW/,+(-0JQ/?y2r+ ^ ^' j- . . 1 _i- j • 

^%9BYW) (12) ^ manner correspoDdmg to the control periormea m tne 

second embodiment and moreover the automatic white 
The new or updated extracting conditions of image 65 balance control is compensated based on the image extract- 
extraction processing circuit 141 (RL, BL'), (RH', BH') ing conditions ofthe image extraction processing circuit 141 
consider the gain adjustment due to the automatic white in a manner corresponding to the control performed in the 
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third embodiment. Thus, extraction of the object can be 
performed with high accuracy by updating the extracting 
condition with reference to the automatic white balance 
control and executing such automatic white balance control 
by making reference to the image extraction processing. 

According to the present invention, as described above, 
when the automatic white balance is controlled during 
extraction of object, the automatic white balance can be 
controlled by making reference to the image extraction 
processing and the extracting condition can be updated by 
making reference to the automatic white balance control in 
the image pickup apparatus providing the image extracting 
function. Thereby, it is now possible to extract the object 
v/ith high accuracy, considering the automatic white balance 
control. 

Although preferred embodiments of the present invention 
have been described and illustrated, it will be apparent to 
those skilled in the art that various modifications may be 
made without departing from the principles of the invention. 

What is claimed is: 

1. An image pickup apparatus comprising: 

an image pickup unit which converts an optical image into 

an image signal; 
a signal processor which processes the image signal from 

the image pickup unit, the signal processor performing 

automatic white balance control on the image signal; 
an image extracting unit which extracts an object by 

extracting a portion of the image signal representing the 

object; and 

a controller which controls the signal processor and the 
image extracting unit so as to enable accurate extrac- 
tion of the object while substantially preventing a 
malfunction in the extraction of the object due to 
performance of the automatic white balance control 
during the extraction of the object; 

wherein the controller controls the signal processor to 
inhibit the automatic white balance control during the 
extraction of the object by the image extracting unit. 

2. An image pickup apparatus comprising: 

an image pickup unit which converts an optical image into 

an image signal; 
a signal processor which processes the image signal from 
the image pickup unit, the signal processor performing 
automatic white balan ce control on the ima ge signal; 
an image~extfacting unit which extracts an object by 
extracting a portion of the image signal representing the) 
object^_and__ J 



a controller which controls the signal processor and the 
image extracting unit so as to enable accurate extrac- 
tion of the object while substantially preventing a 
malfunction in the extraction of the object due to 
performance of the automatic white balance control 
during the extraction of the object; 

wherein the controller effects control by updating an 
extracting condition of the image extracting unit in 
accordance with the automatic white balance control 
performed by the signal processor when the signal 
processor performs the automatic white balance control 
during the extraction of the object by the image extract- 
ing unit. 

3. An image pickup apparatus according to claim 2, 
wherein the image extracting unit extracts the object using 
a distribution of chromaticity of the object; and 
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wherein the controller updates an extracting condition of 
the distribution of chromaticity of the object. 

4. An image pickup apparatus comprising: 

an image pickup unit which converts an optical image into 

an image signal; 
a signal processor which processes the image signal from 

the image pickup unit, the signal processor performing 

automatic white balance control on the image signal; 
an image extracting unit which extracts an object by 

extracting a portion of the image signal representing the 

object; and 

a controller which controls the signal processor and the 
image extracting unit so as to enable accurate extrac- 
tion of the object while substantially preventing a 
malfunction in the extraction of the object due to 
performance of the automatic white balance control 
during the extraction of the object; 

wherein the controller effects control by controlling the 
automatic white balance control performed by the 
signal processor in accordance with the extraction of 
the object by the image extracting unit when the signal 
processor performs the automatic white balance control 
during the extraction of the object by the image extract- 
ing unit. 

5. An image pickup apparatus according to claim 14, 
wherein the controller further effects control by updating an 
extracting condition of the image extracting unit in accor- 
dance with the automatic white balance control performed 
by the signal processor. 

6. An image pickup apparatus according to claim 5, 
wherein the image extracting unit extracts the object using 
a distribution of chromaticity of the object; 

wherein the controller updates an extraaing condition of 
the distribution of chromaticity of the object; and 

wherein the controller controls the automatic white bal- 
ance control performed by the signal processor in 
accordance with a distribution of chromaticity of the 
extracted object. 

7. An image pickup apparatus according to claim 4, 
wherein the image extracting unit extracts the object using 
a distribution of chromaticity of the object; and 

wherein the controller controls the automatic white bal- 
ance control performed by the signal processor in 
accordance with a distribution of chromaticity of the 
extracted object. 

8. An image pickup apparatus comprising: 

an image pickup unit which converts an optical image into 
an image signal and provides an output thereof; 

a signal processor which processes the image signal 
outputted from the image pickup unit, the signal pro- 
cessor performing automatic white balance control on 
the image signal; 

an image extracting unit which extracts a portion of the 
image signal representing an object; and 

a controller which controls the signal processor and the 
image extracting unit; 

wherein the controller controls the signal processor to 
inhibit the automatic white balance control during the 
extraction of the portion of the image signal represent- 
ing the object by the image extracting imit. 
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